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Abstract 

We study the angular correlation and the amount of top quark polarization in the production 
of a higgs boson in association with a single top quark in the channel at the LHC. We also 
study the effect of anomalous Wtb couplings on the angular correlation and on the production 
cross section of the process. The cross section and angular correlation is almost insensitive to 
the variation of the Higgs boson mass within 3 GeV. The robustness of the angular correlation 
against the center-of-mass energy of the proton-proton collision, the variation of parton distri- 
bution functions, and the change of factorization scale is investigated. The sensitivity of this 
process to the anomalous couplings is examined. 



PACS number(s): 14.65.Ha, 14.80.Bn, 12.60.-i 



1 Introduction 



The Higgs boson discovery has been one of the most challenging goals of present high-energy 
experiments, in particular at the LHC experiments. From another side, the study of top quark 
interactions provide a window to new physics beyond the Standard Model (SM). Because of 
the large mass of the top quark, it is maximally coupled to the Higgs boson. Therefore, its 
interactions seem to be more sensitive to the mechanism of electroweak symmetry breaking 
than other Standard Model particles [ID,l|2l,[l3l,[l4l,[|3,[l6l. Recently, LHC experiments have 
observed an excess above the expected background, at a mass near 125 GeV, which is the signal 
for production of a new particle. The measured significance for a SM Higgs boson with this 
mass is 5.8 standard deviations [|71. 

In the top quark sector, one should note that the top quark couplings still need to be mea- 
sured more precisely because it can provide a place to observe any deviations from the SM 
predictions. In this work, by adopting an effective Lagrangian approach, the new physics ef- 
fects are parameterized in terms of higher dimensional operators constructed from the Standard 
Model fields MM- 

^eff = UM + Y^-^ + --- (1) 

where in the above relation c,'s are dimensionless coefficients pointing to the strength of the 
anomalous couplings, Oi are dimension 6 gauge invariant operators containing the Standard 
Model fields and A is the new physics scale. It is notable that due to the excellent agreement 
between the SM expectations and the present experimental data, any deviations from the SM 
are expected to be small. Accordingly, the new effective terms must be very small and the inter- 
ference term between SM and new effective terms could be big enough to be measured. With 
on-shell top, bottom quark and W boson, the most general form of the Wtb vertex originating 
from the dimension six operators can be written as follows [.1 lJ . [[T2l . [|T0l : 

- V 

Leff = -^b[j^{VLPL + VRPR) + '-^{gLPL + gRPR)]tW^ + h.C., (2) 

v2 mw 

where q is the momentum of the involved W boson, Pr^l — g is the weak coupling. Within 
the Standard Model, only the first term with = Vth — ^ is present and the remaining terms are 
anomalous terms which vanish at tree level and can be generated by radiative corrections. The 
assumption of CP conservation leads that V^R,gL_R to be real. 

There are indirect and direct constraints on the anomalous couplings. The indirect con- 
straints have been extracted from the measured branching ratio oi b ^ sj. In particular, the 
bounds on Vr and gi are tight. These bounds are stronger than what can be possibly obtained 
from studying the top quark production and decay at the LHC. This is because of the fact that 
the decay amplitude of B-meson is enhanced by a factor mj/nit,. The bounds are presented 
below Oil: 

-0.0007 <yi;< 0.0025, - 0.0013 <^L< 0.0004, -0.15 < < 0.57 (3) 

The recent direct constraints on the anomalous couplings have been obtained using pp 
collision data corresponding to an integrated luminosity of 5.4 fb^^ collected by the DO de- 
tector. The analysis is based on the ^-channel and ^'-channel single top quark production cross 
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Figure 1 : Feynman diagrams contributing to the ^-channel single top plus Higgs production at 
hadron colliders. 

sections. The result represents the most stringent direct limits on anomalous Wtb couplings 
which can be found in the following (assuming ^ 1) [14]: 

\Vr\ < 0.96 , \gL\ < 0.36 , l^^l < 0.24 (4) 

As it can be seen, the indirect constraints are much stronger than the direct ones except 
for the upper constraint on gR. In spite of the direct constraints, the indirect bounds are not 
symmetric. In this work, because of the strong limit on Vr and for simplicity we do not consider 
it. There are several studies on the anomalous Wtb couplings which for example some of them 
can be found in flU, [|Il,|[ni,[[Il,[IIl, m, [|2ll,ll22l,[l2l,|l24l,[|25l. 

At the LHC, the production of Higgs and single top quark are through three channels: 
f-channel (qb — )■ q'tH), 5-channel (qq' btH), and W-associated {gb — )■ tW~H) [|26ll . Since t- 
channel has the largest cross section among these channels, we only focus on the ^-channel. The 
possibility of detection a signal for the ^-channel process (which has the largest cross section) at 
the LHC, via the Higgs decay into bb has been discussed in [26]. Figure [T] shows the Feynman 
diagrams for the f-channel process. 

In single top production in the ^-channel mode {qb — )■ q't), the top quarks are produced 
highly polarized along the direction of the light-quark in the final state [|27l . ll28l . The top 
quark spin is maximally correlated with the light-quark momentum in the final state and this 
correlation can be observed in the angular distribution of the top decay products. 

In this paper, first we study the spin correlation effect for the production of a Higgs boson 
plus a single top in the ^-channel at the LHC {qb — t- q'tH) in the Standard Model. We investi- 
gate the robustness of the spin correlation against variation of the parton distribution functions 
(PDFs), variation of the factorization scale, and change of the center-of-mass energy of proton- 
proton collision. Then we investigate the effect of anomalous Wtb couplings as introduced in 
Eq(2]on the spin correlation and the production cross section of the qb — t- q'tH process. We also 
study the change of cross section with the anomalous couplings and its sensitivity to the Higgs 
boson mass. The angular correlation distribution of the charged lepton is used to examine the 
sensitivity of this process to the anomalous couplings gi and gR. All results are presented at the 
LHC with the center-of-mass energy of 8 TeV. 

The paper is organized as follows. In section 2, the spin correlation in the process of 
qb — q'tH is investigated. In section 3, we investigate the dependency of the cross section of 
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the f-channel process to the anomalous couplings for different Higgs boson masses as well as 
the spin correlation distribution. We also present the dependence of the rapidity distribution 
of the light quark to the anomalous couplings. In section 3, using the charged lepton angular 
distribution, the sensitivity of the process to the anomalous couplings is examined. Section 4 is 
dedicated to conclusions. 



2 Spin Correlation in qb — > q'tH 



It is well-known that for the decay of a top quark into a charged lepton, a b-quark and a neutrino 
the angular distributions in the top quark rest frame is given by: 

I dY I , 

t;-. ^ = - l+a,cose,0 (5) 

r a COS 0/ 2 

where 9/ is the angle between the top spin and the three-momentum of the i\h product. The 
constants a,- are called spin correlation coefficients or spin analyzing power of the z'th product 
which varies from -1 to 1. In the SM at tree level, a/+ = l,av, = —0.319 and = —0.406. 

In the ^-channel single top production {qb — )■ q't), top quarks are produced highly polar- 
ized along the light-quark direction in the final state. The corresponding angular distribution of 
the charged lepton in the top quark decay is given by: 

1 ^/r 1 

- = -(l + fPa/cos0/) (6) 

FacosG/ 2 

where the angle 0/ is the angle between the charged lepton momentum and the top spin quan- 
tization axis in the top quark rest frame. ^P is the spin asymmetry and it is dependent on the 
basis. In a basis where top quarks are 100% polarized, '2=1. Choosing the momentum of the 
light-quark {q') in the final state ("spectator basis") as the spin quantization axis leads to high 
degree polarization for the top quark (ff* = 97%). There is another basis which is called "beam 
line" basis where the polarization degree is less than the spectator basis (271, [|29l , [|30l , [|3n . 

Now, we investigate the spin correlation in the process of qb — )■ q'tH and try to obtain the 
the degree of polarization in the spectator basis for this process. This has been calculated using 
tree-level matrix elements generated by CompHEP [33J convoluted with the parton distribution 
function set CTEQ6L [[341. We used = 173.1 GeV and = 1.4 GeV. We consider the top 
quark decays into a V7-boson and a ^-quark and then VF-boson decays into a charged lepton 
and a neutrino. Figure |2]depicts the angular correlation distribution of the charged lepton in the 
spectator basis for three values of the Higgs boson mass. 

As it can be seen in Figured similar to the process qb — t- tq' , a linear behavior is observed. 
Thus, we fit a linear function of az + b, where z = cos 0, to the angular distribution to extract the 
parameters a and b. Comparing with Eq. |6l a = ^Pa^ If we assume «/ = 1 then a = (P. For the 
Higgs boson mass m// = 125 GeV, we obtained (P to be 76.4%. Variation of the Higgs boson 
mass within 5 GeV leads to a negligible change of 3% in the spin asymmetry. It is interesting 
to note that with respect to the single top ^-channel process qb q't, in the spectator basis, the 
spin asymmetry in this process is degraded around 22%. 

Now, we check the sensitivity of the polarization degree to the change of proton parton 
distribution functions and the variation of the factorization scale. In order to examine the influ- 
ence of the choice of PDF on the polarization degree !P, we compare the angular distributions 
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Figure 2: Angular correlation in single top and anti-top for various Higgs boson mass in the 
spectator basis. 




Figure 3: Angular distribution using three PDF sets (left) and for three values of factorization 
scale with a given PDF set (right). 



obtained with CTEQ6L1, CTEQ5L, and MSTW2008nlo. Figure H (left plot) shows the resuks. 
As it can be seen, no considerable differences is observed when we use different set of PDFs. In 
the spectator basis, the maximum differences in T between using three PDF sets is 1.5%. Fig- 
ure |3](right plot) shows the angular distribution for a given PDF set (CTEQ6L1) with various 
factorization scales = nit /l.mt.lnit. According to figure, the polarization does not receive 
any substantial changes when different factorization scales are used in the calculations. The 
difference is at the level of 1%. 

The Large Hadron Collider has started its operation with the center-of-mass energy of 7 
TeV and around 5 fb^ of data collected by the experiments. Large amount of data (around 20 
fb~^) has been collected at 8 TeV center-of-mass energy in 2012. The plan is to increase the 
energy to larger value in the upgrade of the machine. Thus, it is useful to check the dependency 
of the polarization to different center-of-mass energies at the LHC. Figure |4] shows the angular 
distribution for three center-of-mass energies of the proton-proton collisions in the spectator 
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Figure 4: Angular distribution for various center-of-mass energies in the spectator basis at the 
LHC. 

basis. The degree of polarization is stable against variation of the center-of-mass energies. Note 
that the center-of-mass energies are chosen large enough above the threshold of production. 

3 Associated Production of a Single Top and a Higgs Boson 
with Anomalous Wtb interactions 

In this section we focus on the effect of the anomalous Wtb interactions on the ^-channel 
(qb — )■ q'tH) single top quark production in association with a Higgs boson. This has been 
calculated using tree-level matrix elements generated by CompHEP ll33l convoluted with the 
parton distribution function set CTEQ6L1 [|34l . The top quark mass has been taken = 173. 1 
GeV and its width is 1 .4 GeV. 

With the general effective Lagrangian for the Wtb coupling, the cross section of the t- 
channel can be parameterized as the following: 

o = OsMiVtl +Ai X gl +A2 X gl +A3 X VtbgL +A4 X VtbgR +A5 X gigR) (7) 

where we have taken Vi = Vtb—l - Aj coefficients determine the dependence of the cross section 
to the anomalous couplings. These coefficients are dependent on the proton parton distribution 
functions (PDF's) as well as the Q-scale and other parameters such as masses of the top and 
bottom quarks. It should be noted that A,- factors are different for top quark and anti-top quark 
production cross sections. 

In Table[Tl the A, coefficients are listed for three different masses of the Higgs boson. The 
cross section of the single top (anti-top) process within the SM (Osm) is 10.627 (4.634) fb for 
MM = 125 GeV/c2. 

As it can be seen in Table [H the coefficients of gj^ and gj^ terms are greater than the other 
terms. This has been expected from qy factor in the interaction which has an enhancement effect 
on the cross section. Similar situation occurs in the SM single top production with anomalous 
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Table 1: The coefficients of anomalous terms appear in the cross section of the ^-channel pro- 
cess for three values of the Higgs boson mass for single top and single anti-top quark separately. 



niH [GeV/c^] 




A' 








A', 


A' 


A' 


124 


14.178 


7.603 


-2.645 


-0.0626 


8.669 


15.553 


-1.250 


-0.0264 


125 


14.041 


7.500 


-2.623 


-0.0644 


8.634 


15.507 


-1.237 


-0.0277 


127 


13.963 


7.422 


-2.605 


-0.0464 


8.488 


15.312 


-1.221 


-0.0271 




Figure 5: The relative correction coming from the anomalous interactions to the cross section 
for production of Higgs plus single top in the ? -channel at the LHC (pp, y/s = 8 TeV). The 
dependence of the change of cross section on gR (left) and on gi (right) for nin — 125 GeV. 

couplings ll39l . According to Tabled] the coefficient of the interference term Vtbgi is of order of 
unity and could not be neglected. While the coefficients of terms VtbgR and gLgR are very small, 
at the order of 10^ and 10^, respectively. Therefore, it might not be a precise assumption to 
take only one non-zero anomalous coupling at a time. 

In comparison between the coefficients of single top and single anti-top quarks in Table 
[B it is notable that the coefficient of gj^ term in single top is larger than single anti-top while the 
situation is vice versa for the gj^ term. Therefore, the ratio of the top to anti-top cross section is 
more sensitive to gi. 

From Table [T] it can be seen that the coefficients are sensitive to the Higgs boson mass. 
However, the sensitivity is not significant. The coefficients change by less than 2% when the 
Higgs boson mass varies within 3 GeV. 

Fig. [5] depicts the relative change of the cross section for production of a Higgs boson 
plus a single top in the ^-channel at the LHC with the center-of-mass energy of y/s = 8 TeV in 
the presence of the anomalous Wtb interactions. The dependence of the change of cross section 
on gR (left) and on gi (right) is for m// = 125 GeV. 

By comparing both plots in Fig. [51 one can observe that the cross section is more sensi- 
tive to gi (left-handed with tensor structure) than gR (right-handed with tensor structure). For 
example, the contribution that the cross section can receive from gi = 0.05 reaches up to 20% 
while from gR = 0.05 is 6%. According to Fig. |5]the anomalous term of gi could be destructive 
and reduces the cross section from its Standard Model value up to around 20% while gR always 
increases the cross section. 
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Figure 6: Rapidity distribution for the light quark in the final-state in the t-channel at the LHC. 



One of the interesting aspect of the ^-channel process is that the light-quark in the final 
state tend to fly in the forward/backward region of the detector. The presence of a light-jet 
in the forward or backward region is related to the cross section behavior as a function of the 
momentum of the virtual -boson exchanged in the ^-channel. Similar to the f-channel single 
top production (without Higgs boson in the final state), the region —q^ < dominates [|35l . 

In Fig. [6] we present the rapidity distribution of the light-quark in the final-state of the 
f-channel in the SM framework and in the presence of anomalous couplings with for example 
gL = 8r = 0.5. As it can be seen in Fig. [6l the light quark tends to reside at large rapidities, 
peaking at around the value of 3 in the SM framework which is corresponding to an angle 
of around 5.7°. The interesting point is that the presence of anomalous couplings leads the 
light quark to be more central. For example, when gt = gR = 0.5 the light quark rapidity 
distribution is peaking at around 2 (corresponding to an angle of 15.4°), one unit below the 
SM case. Therefore, in the presence of the anomalous couplings the spectator quark tends 
to fly more central and it affects the spin correlation and angular distribution which have been 
discussed in the previous section. In the next section, we use the angular distribution to examine 
the sensitivity of the process to the anomalous couplings. 



4 Sensitivity to Anomalous Couplings 

As we showed in section 2, there is a correlation between the spin of the top quark and the 
three-momentum of the light-quark in the top quark rest frame. The polarization degree in 
qb — )■ q'tH process in the spectator basis is around 76% for itih = 125 GeV. The presence of 
anomalous couplings in the vertex of Wtb changes this polarization degree. In Table |2l the 
degree of polarization is shown for various values of gi and gR in the spectator basis. There are 
interesting observations: 

• When we change in the range of 0.0 to 0.1, an increase of around 4% is seen with 
respect to the SM expectation and when we move in the negative direction from 0.0 to 
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Table 2: The coefficients of anomalous terms appear in the cross section of the ^-channel pro- 
cess for three values of the Higgs boson mass for single top and single anti-top quark separately. 



gL 


gR 


Degree of Polarization 


0.1 


0.0 


0.7938 


0.0 


0.1 


0.7963 


0.1 


0.1 


0.8091 


-0.1 


-0.1 


0.5392 


0.2 


0.2 


0.6030 


-0.2 


-0.2 


0.3416 


-0.1 


0.0 


0.5536 


0.0 


-0.1 


0.7497 



-0.1, we face with a decrease of 3 — 4%. Therefore, the polarization degree is weakly 
sensitive to gR. 

• For the case that gi varies from 0.0 to 0. 1 , there is an increase of 3 — 4% in the polariza- 
tion degree while variation from of gi from 0.0 to -0.1 leads to a significant deviation of 
27%. The polarization degree is strongly sensitive to gi when gi < 0.0. 

In summary, the angular correlation of the charged lepton is more sensitive to gt than gR 
and in particular to negative values of gi. We use the charged lepton angular distribution to 
examine the sensitivity of this process to the anomalous couplings. 

To obtain a realistic estimation of the sensitivity of the single top in association with the 
Higgs boson in ^-channel, one has to consider all backgrounds, selection cuts, and detector 
effects. However, a comprehensive analysis taking into account all backgrounds and detector 
effects is beyond the scope of this paper and must be performed by the experimental collabora- 
tions. 

In this study, we use criterion from the charged lepton angular distribution to estimate the 
sensitivity to the anomalous couplings: 

xHgL.gR) = E r ^''f^ ^' f (8) 

i=bins ' 

where N"^^ is the number of expected events in zth bin of the charged lepton distribution in 
the presence of anomalous couplings. The same as [26], we consider the leptonic decay of the 
W-boson form the top quark and the decay of the Higgs boson to bb. Since for a Higgs boson 
lighter than 130 GeV/c^, the dominant decay mode is bb, we will have more statistics with this 
choice. Therefore, our final state consists of Z^+Missing Transverse Energy(MET)-i-3Z?jet+ one 
light forward jet. As discussed in [|26l and in a more recent paper [32], the main backgrounds 
are tt, tt j, tZ j with Z — )• bb, and tbb j. Following the set of cuts proposed in [32] leads to 
significant suppression of the backgrounds. In [l32l, the acceptance cuts has been taken similar 
to the ATLAS analysis of ttH [36]. The transverse momenta of the charged lepton and the 
bjet are required to be greater than 25 GeV with |ri/^| < 2.5. The light jet must have px > 30 
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Figure 7: The cos distributions of the charged lepton in top decay for signal and backgrounds 
after the cuts. 

and |ri| < 5.0. It is also required that ARij > 0.4. Where ARjj = \/(ri/ - r[j)^ + ((|)/ - (|)j)2, this 
requirement is applied on all objects. No cut on MET is applied. In the definition, A, denotes 



the uncertainties in each bin of the angular distribution and is defined as: A, = Nf'^ J S^tat + 



After imposing the kinematic cuts, the charged lepton angular distributions are distorted. A 
significant drop in the region of cos ~ 1 appears which is mainly originating from the pj and 
AR cuts. This behavior has been already observed in the SM single top production qb — )• tq'. It 
is important to note that the main characteristic feature of signal in the charged lepton angular 
distribution, which is a distinct slope, remains. The background has a flat distribution even after 
the cuts are imposed. In the SM single top production qb — )■ tq', this feature remains after full 
detector simulation and has been observed in real data too [|37ll . 

To get a rough estimate of the limits on the anomalous couplings, we consider an inte- 
grated luminosity of 25 fb^^ of data. The 68% C.L. interval for gi and gj^ are [—0.32, 0.65] and 
[—0.74, 0.74], respectively. Indeed, these are rough estimations and in the realistic case detector 
effects, all backgrounds must be taken into account. Because of smaller statistics, the limits that 
obtained from single top production in association with the Higgs boson process are looser than 
the ones that can be obtained from for example f-channel single top |[391 . However, the same 
as fi39il where all single top channels have been combined, the combination of this channel with 
other sensitive channels can improve the constraints on the anomalous terms [I38l . [l39l . ll40i . 

5 Conclusions 

In this paper, we studied the single top quark production in association with a Higgs boson at 
the LHC, namely qb — )■ tq'H. In particular, we concentrated on the spin correlation effects in 
this process within the SM framework and in presence of the anomalous Wtb couplings. We 
have found that in the SM, in the process of qb tq'H, the top quarks are ~ 76% polarized in 
the direction of the light-quark q' in the final state. It was shown the polarization degree deviates 
negligibly by changing the PDF set and the center-of-mass energy of the collision (7,8,14 TeV). 
The dependence of the spin correlation on the factorization scale has been found to be 1%. 
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We found that the amount of change in cross section with the anomalous couplings is 
around 2% when the Higgs boson mass varies 3 GeV/c^. Variation of the Higgs boson mass 
has a weak effect on the top polarization degree. The cross section was found to be strongly 
sensitive to the anomalous couplings giigR- The gR anomalous coupling contribution to the 
cross section is always constructive. On the contrary, the gi anomalous coupling can contribute 
to the cross section destructively (0.0 < gL< 0.2). It is interesting to note that the cross section 
is more sensitive to gi than g^. 

Since the charged lepton in the top quark decay is maximally correlated with the top 
quark spin, we performed a parton level study to examine the anomalous Wtb couplings in this 
process by focusing on the top quark leptonic decay and the Higgs boson decays into bb. After 
imposing a set of kinematic cuts, we showed that the angular distribution of the charged lepton 
remains as a sloped line (except for the region of cos ~ 1, which is due to the pr and AR cuts). 
The flatness of background shape remains after the cuts. We examined the sensitivity to the 
anomalous couplings using the charged lepton angular distribution. With 25 fb^ of data, the 
68% C.L. interval for gL and gR have been found to be [-0.32,0.65] and [-0.74,0.74]. 

Note added: When this work was being completed, a partly similar work appeared in 
[|4T1l where the dependence of cross section on the anomalous couplings has been studied. 
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